Smart Exploration in HetNets: Minimizing Total Regret with mmWave
نویسندگان
چکیده
We model and analyze a User-Equipment (UE) based wireless network selection method where individuals act on their stochastic knowledge of the expected behavior off their available networks. In particular, we focus on networks with millimeter-wave (mmWave) radio. Modeling mmWave radio access technologies (RATs) as a stochastic 3-state process based on their physical layer characteristics in Line-of-Sight (LOS), NonLine-of-Sight (NLOS), and Outage states, we make the realistic assumption that users have no knowledge of the statistics of the RATs and must learn these while maximizing the throughput obtained. We develop an online learning-based approach to access network selection: a user-centric Multi-Armed Bandit Problem that incorporates the cost of switching access networks. We develop an online learning policy that groups network access to minimize costs for RAT selection, analyze the regret (loss due to uncertainty) of our algorithm. We also show that our algorithm obtains optimal regret and achieves 24% increase in total throughput compared to existing techniques for high throughput mmWave RATs that vary over a fast timescale.
منابع مشابه
Backhaul-Aware Decoupled Uplink and Downlink User Association, Subcarrier Allocation, and Power Control in FiWi HetNets
Decoupling the uplink and downlink user association improves the throughput of heterogeneous networks (HetNets) and balances the traffic load of macro- and small- base stations. Recently, fiber-wireless HetNets (FiWi-HetNets) have been considered as viable solutions for access networks. To improve the accuracy of user association and resource allocation algorithms in FiWi-HetNets, the capacity ...
متن کاملModeling and Analysis of MmWave Communications in Cache-enabled HetNets
In this paper, we consider a novel cache-enabled heterogeneous network (HetNet), where macro base stations (BSs) with traditional sub-6 GHz are overlaid by dense millimeter wave (mmWave) pico BSs. These two-tier BSs, which are modeled as two independent homogeneous Poisson Point Processes, cache multimedia contents following the popularity rank. High-capacity backhauls are utilized between macr...
متن کاملEfficient Reinforcement Learning via Initial Pure Exploration
In several realistic situations, an interactive learning agent can practice and refine its strategy before going on to be evaluated. For instance, consider a student preparing for a series of tests. She would typically take a few practice tests to know which areas she needs to improve upon. Based of the scores she obtains in these practice tests, she would formulate a strategy for maximizing he...
متن کاملApplications of Economic and Pricing Models for Resource Management in 5G Wireless Networks: A Survey
This paper presents a comprehensive literature review on applications of economic and pricing theory for resource management in the evolving fifth generation (5G) wireless networks. The 5G wireless networks are envisioned to overcome existing limitations of cellular networks in terms of data rate, capacity, latency, energy efficiency, spectrum efficiency, coverage, reliability, and cost per inf...
متن کاملEvaluation of Influencing Factors on Tubal Sterilization Regret: A Cross-Sectional Study
Objective The aim of this study is to evaluate the menstrual pattern, sexual function, and anxiety, and depression in women with poststerilization regret, and potential influencing factors for regret following TL in Iranian women. MaterialsAndMethods In this cross-sectional study, 166 women with TL were subdivided into two groups including women with poststerilization regret (n=41) and women wi...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2016